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Abstract 



The (S, A)-Fleming-Viot process with mutation is a probability-measure-valued process 
, whose moment dual is similar to that of the classical Fleming- Viot process except that 

■ the Kingman's coalescent is replaced by the S-coalescent, the coalescent with simultaneous 

(-H , multiple collisions. We first prove the existence of such a process for general mutation 

generator A. We then investigate its reversibility. We also study both the weak and strong 
uniqueness of solution to the associated stochastic partial differential equation. 
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2 ■ 1 Introduction 

(N 

The classical Fleming- Viot process is a probability-measure-valued process for mathematical 
population genetics. It describes the evolution of relative frequencies for different types of 
alleles in a large population undergoing resampling together with possible mutation, selection 
' and recombination; see Ethier and Kurtz [TU] and references therein for earlier work on the 



classical Fleming- Viot process. When the classical Fleming- Viot process only involves mutation 
and resampling, it is well-known that its moment dual is a function-valued Markov process 
governed by the Kingman's coalescent and the mutation semigroup. 

During the past ten years, more general coalescents have been proposed and studied by many 
authors. For examples, the A-coalescent (cf. Pitman |20j and Sagitov j21j ) is a coalescent with 
possible multiple collisions and the H-coalescent (cf. Mohle and Sagitov [19] and Schweinsberg 
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|23j ) is a coalescent with possible simultaneous multiple collisions. It is then interesting to know 
whether there exists a generalized Fleming- Viot type probability-measure- valued process whose 
dual is a function-valued process evolving in the same way as the classical Fleming- Viot dual 
but with the Kingman's coalescent replaced by the H-coalescent. 

Such a generalized Fleming- Viot process was first considered by Donnelly and Kurtz [9j and 
Hiraba [13]. When the spatial motion of the particle is negated, namely, the mutation is 0, it has 
also been studied by Bertoin and Le Gall ([2], [3], [5, [5]) and Birkner et al [7]. In particular, 
a special form of such process is constructed in [3] using the weak solution flow of a stochastic 
equation driven by a Poisson random measure. Generalized Fleming- Viot processes with parent 
independent jump mutation operators are constructed by Dawson and Li [8] as strong solutions 
of stochastic equations driven by time-space white noises and Poisson random measures. The 
classical Fleming- Viot process with Laplacian mutation operator is characterized by Xiong [25] 
as the strong solution of an SPDE driven by a time-space white noise. The common feature of 
the approaches of H] , [8] and [25] is to consider the processes of distributions of the measure- 
valued processes instead of their density processes. In fact, the processes studied in [3] and 
[8] are usually not absolutely continuous. Similar stochastic equations for Dawson- Watanabe 
superprocesses have also been studied in [5], [S], [S] and [25]. 

This problem is also studied in the recent work of Birkner et al [6]. When the mutation 
generator A is the generator for a pure jump Markov process, two constructions of the (H, A)- 
Fleming-Viot process are found in [6] . One construction is based on modification of the lookdown 
scheme of [9] applied to exchangeable particle systems for the classical Fleming- Viot process. 
The (H, ^)-Fleming-Viot process arises as the pathwise almost sure limit of the empirical mea- 
sure for the exchangeable particle system. The other construction is based on the Hille-Yosida 
theorem. The resulted process gives an example of probability-measure-valued superprocess of 
jump diffusion type. 

In this paper, we further study the existence and various properties of this generalized 
Fleming- Viot process. We first formulate a well-posed martingale problem and show that the 
(H, ^)-Fleming-Viot process X with general mutation generator is the unique solution to such 
a martingale problem. We then show that X has a unique invariant measure if the mutation 
process allows a unique invariant measure. 

The reversibility of a population genetic model is an important issue for statistical inference. 
The reversibility for the classical Fleming- Viot process has been investigated in Li et al [18] 
using Dirichlet forms and in Handa |12j and Schmuland and Sun [23j via cocycle identity. The 
reversibility for an interacting classical Fleming- Viot process is studied in Feng et al [11]. We 
also consider the reversibility for (S, ^)-Fleming-Viot process in this paper. By adapting the 
approach of [18] we first show that for the (S, ^)-Fleming-Viot process X to be reversible, 
the mutation generator A is necessary a parent independent jump generator. Furthermore, 
if the type space contains at least three points or it contains two points with non identical 
mutation rates to them, to be reversible the H-coalescent for the Fleming- Viot process has to 
degenerate into the Kingman's coalescent. When the type space contains exactly two points 
with equal mutation rates to them, we show that the above-mentioned result is still valid for 
several examples where explicit computations can be carried out. 

When the mutation generator A is the one-dimensional Laplacian operator, we further study 
the SPDEs associated with the (H, ^)-Fleming-Viot process. In order to establish the strong 
uniqueness we associate the SPDE to a backward SDE and then prove the pathwise uniqueness 
of the backward SDE using a Yamada- Watanabe type argument. Such an approach was first 
proposed in [25] to prove the strong uniqueness of SPDE arising from super-Brownian motion 
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and Fleming- Viot process over the real line. 

The rest of this article is organized as follows. In Section 2 we first introduce the (H, A)- 
coalescent, which serves as the dual to the (H, ^)-Fleming-Viot process. In Section O we give a 
new construction of the (S, ^)-Fleming-Viot with general mutation generator A. In Section 
we study the ergodicity and the reversibility of this process. Finally, in Section [S] we study an 
SPDE associated to the (H, 74)-Fleming-Viot process with A being the Laplacian operator. We 
prove the strong uniqueness of the solution to this nonlinear SPDE driven by a Brownian sheet 
and a Poisson random measure. 

2 The (S, 74)-coalescent 

We first borrow some notation from Bertoin pQ. Put [n] := {l,...,re} and [oo] := {1,2,...}. 
A partition of D C [oo] is a countable collection vr = {vrj,^ = 1,2, . . .} of disjoint blocks such 
that UjVTj = D and minvTj < minvTj for i < j. Let Vn denote the set of partitions of [n] and 
"Poo denote the set of partitions of [oo]. Write 0[„] := {{1},... for the partition of [n] 

consisting of singletons. 

Given a partition vr S Vn for some n and vr' G Vk with |7r| < k where |7r| denotes the 
cardinality of vr, the coagulation of vr by vr', denoted by Coag(vr, vr'), is defined as the following 
partition of [n], 

vr" = {vr;:= U^e^^vri : j = 1, . . . , |vr'|} . 

For example, for vr = {{1,3}, {2}, {4, 5, 9}, {6, 8}, {7}} and vr' = {{1, 5, 6}, {2, 3, 4}}, we have 

Coag(vr, vr') = {{1,3, 7}, {2, 4, 5, 6, 8, 9}} . 

Given a partition vr with |vr| = b and a sequence of positive integers s,ki, . . . ,kr such that 
ki > 2,i = 1, . . . ,r and b = s + ki, we say a partition vr" is obtained hy a {b; ki, . . . , kr, s)- 
collision of vr if vr" = Coag(7r, vr') for some partition vr' such that 

{|vr-| : I = 1, . . . , |vr'|} = {ki,...,kr, kr+i, • • • , K+s}, 

where /cr+i = • • • = k^+s = !> i-e. vr" is a merger of the b blocks of vr into r + s blocks in which 
s blocks remain unchanged and the other r blocks contain ki, . . . ,kr blocks from vr. 

The S-coalesceni is a "Poo-valued coalescent Hoc = (IIoo(t))t>o starting from partition Hoc (0) G 
"Poo such that for any n € [oo], its restriction to [n], n„ = {Iln{t))t>o is a Markov chain and that 
given Unit) has 6-blocks, each (6; /ci, . . . , fc,-; ■s)-collision occurs at rate Xb]ki,...,kr;s- For the H- 
coalescent to be well defined, it is sufficient and necessary that there is a nonzero finite measure 
H = Hq + cT^Jo on the infinite simplex 

A = |x = {xi,X2, . . .) : xi > X2 > • • • > 0, y^Xj < l| 

such that Hq has no atom at 0, 6o denotes a point mass at 0, cr > is a constant and 

^b;ki,-,kr;s = Cr^f{r=l,ki=2} + Pb;ki,...,kr;s, 

where 

Pb-M,...,kr;s = f t: E fl-f;x,) 1^ (2.1) 
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denotes the rate of simultaneous multiple coalescent with Hq being the measure of multiple 
coagulation and o"^ denotes the rate of binary coagulation. As a result, the coagulation rates 
satisfy the consistency condition 

r 

\-M,...,kr\s = \+l]ki,...,km-l,k-m+l,km+i,---,kr\s + S^+l'M ,. . . ,kr ,2\s~l + \+l;ki . . ,kr]S+l ■ 

m=l 

See Schweinsberg [23] . 

When the measure H is supported on [0,1], the corresponding coalescent involves at most 
multiple collisions. Such H-coalescents are also called A-coalescent. 

A Poisson process construction of H-coalescent is given in |23j as follows. For each x = 
(xi, X2, . . .) € A let Px be a probability measure on such that 

P^{z = {zi,...)eZ'^ ■.z,=j} = Xj, 

oo 

Px{z : Zi = -i} = I - '^ Xj 
and for any n € [oo] and (ki, . . . , A;„) G Z", 

n 

Px{z : Zi = ki,i = 1, . . . ,n} = Y\_ -Px{z : Zi = ki}. 

i=l 

Then define a measure L on by 

f " \ oo oo 

J A 2^j=i Xj .^^ .^.^^ 

where Zjj = (zi, . . .) with Zi = Zj = 1 and = —k for /c ^ {i,j}- Let (e(t))t>o be a Z°°-valued 
Poisson point process with characteristic measure L. Let (e„(t))f>o be the process {e{t))t>o 
restricted to Z". Notice that e and e„ can be identified as 'Poo-valued and P„-valued process, 
respectively, in the obvious way. Then the S-coalescent Hn can be constructed using recur- 
sively. Given n„(0) € Vn and suppose that n„(s) has been constructed for < s < t. Let 
T > t he the first jumping time for after t. Then define n„(s) = Unit) for t < s < T and 
n„(T) = Coag(n„(t), e„(r)). See |23j and references therein for more detailed inductions on 
the H-coalescent. 

Let P be a Polish space containing at least two points. Let B{E) be the set of bounded 
functions on P. Let Mi(P) be the space of Borel probability measures on P. Then Mi(P) 
endowed with the topology of weak convergence is a Polish space. For ^ € Mi(P) and / € B{E), 
write {fi, f) = fi{f) := J fdfi. For n > 1 and / G P(P"), let 

Gnj{^^) = G^inJ) = {ij.\f). (2.2) 

Let Z he a Markov process with state space P, Feller transition semigroup (Pt) and generator 
{A,T>{A)). Process Z describes the mutation mechanism for the Fleming- Viot process. 

Given a function g on P", for each partition vr = {vTj, i = 1, . . . , |7r|} on [n], we define ^-^g as 
a function on P''^' such that $7rgf(xi, . . . ,x^^^) = g{xi^, . . . ,Xi^) with ij = k for ij G VTfc, j € [n]. 
For example, if 51 is a function on P^ and vr = {{1,4}, {2, 3, 6}, {5}}, then 

^T,g{xi,X2,X'i) = g{xi,X2,X2,Xl,X^,X2). 
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For 1 < i < J < n we write ^ij for with 

TT = {{1}, . . . , {i - 1}, + ... , {j - 1}, {j + 1}, . . . , W} . 

The {E,A)-coakscent {M,Z) = {Mt,Zt)t>o with initial value (Mo,Zo) = {n,f)J G 
is a ^l^i{k} X B(S'=)-valued Markov process defined as follows. Let Hn with n„(0) = 0[„] be 
the H-coalescent defined before. For any / G C{E'^), the set of bounded continuous functions 
on equipped with the supremum norm, define semigroup {Pt^'^) by 

» n 
p/"V(^i,...,a:„) := / f{iu...,in)X{Pt{xi,dii). 

Then M := |n„| and Z can be defined iteratively as follows. Write Tq = and Ti < T2 < • • • 
for the sequence of ordered jumping times for n„. For any Tj < i < Tj+i, define 

Zt := p[^'^^^ Zt^ and Zt^^^ = if n„(T-,+i) = Coag(n„(T-,+i-), vr'). 

For any vr G "Pn,"^ 7^ 0[„], write /3,r := f3n;ki,...,kr;s where {n;ki, . . . ,kr] s) is uniquely deter- 
mined by 

{ki, . . . ,kr,l,. . . ,1} = {\TTi\ : 1 < i < |7r|}. 
For fixed /i G Mi(E) and the function given by ()2.2p we define for any f £ (j4^"^), 

L*G^{n, f) =G^(n, ^('^)/) + ^ [G^.{n - 1, - G^(n, /)" 

7reP„\{0[„]} 

where ^^""^ denotes the generator of (^pj^"'^^. Clearly, L* is the generator for the Markov process 
{Mt,Zt). 

3 Existence of the (S, 74)-Fleming-Viot process 

We call an Mi (£^)- valued Markov process X a (S, A)-Fleming-Viot process with H-resampling 
mechanism and mutation generator A if for any n G N, / G B{E^), its moment is determined 

by 

EGnj{Xt)=KGxo{Mt,Zt) (3.1) 

where {M,Z) denotes the (H, A)-coalescent with initial value {n,f), which is defined in the 
previous section. Since process X is probability-measure-valued, its distribution is uniquely 
determined by (|3.ip . 

The (H, 74)-Fleming-Viot process is constructed in Birkner et al [6] for generator A of jump 
type i.e. 

Af{x)=r [ {f{y)-f{x))qix,dy), 
JE 

where / is a bounded function on E, q{x, dy) is a Feller transition function and r > is the 
global mutation rate. 
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In this section, we want to show that the desired probabihty-measure-valued process is weh 
defined for any Feher generator A with transition semigroup {Pt) on C{E). To this end, we want 
to show that the (H, ^)-Fleming-Viot process is the unique solution to a martingale problem. 
Let Dmi [0, oo) be the space of cadlag paths from [0, oo) to Mi[E) furnished with the Skorohod 
topology. 

Let ^1 C C{Mi{E)) be the linear span of the functions of form ()2.2p with n > 1 and 
/ G P(^(")). Let Lq be the linear operator from &i to C{Mi{E)) defined by 

LoG„j(/.) = (^",^(")/) + a2 [(/^"^\^.,/>-(m",/)] (3.2) 

l<i<j<n 

for ^jL € Mi{E). 

Let (7mi[0,oo) be the space of continuous paths from [0,oo) to Mi{E) furnished with the 
topology of uniform convergence. The next theorem follows from Theorem 3.2 of Ethier and 
Kurtz flnl. 



Theorem 3.1 The (Lq, -martingale problem in Cj\/JO, cxd) is well-posed. 

Note that the solution to the (Lq, ^i)-martingale problem is the well-known classical Fleming- 
Viot process. In the generator, only the Kingman's coalescent is represented by the term 
To extend the process, we introduce more general coalescent. 

Fix n and / G 5(S"). For n G Mi{E) define 

BG„j(/.)= Yl -(/"",/>]• (3.3) 

For / G P(A('^)) let L be the hnear operator from &i to C{Mi{E)) defined by 

LGnJ{^i) = LoGnjip) + BGnjifi). (3.4) 

Define test functions F{p) = 0?=! il^^ fi) ^^^Y ^^'^ fi ^ B{E),i = 1, . . . ,n. The 
generator related to the simultaneous multiple part of the H- coalescent is defined as 

tG-P„\{0[„,} \i=l \ jGTT, / i=l J 

The following Lemma shows a different representation for this generator, which has been 
obtained in Birkner et al ^ (Equation (4.2)) for jump type generator A. Its proof is essentially 
the same as [B] and we omit it. 

Lemma 3.2 The generator B can be represented as 

BF(^) = 1^ (^Y ^0 (^^) X, K f E ^j-^-. ^yp, V ^ ' " ^ ' ^^"^ ^'^"'^ 



where Xi,i = 1,2,3, .. . are independently and identically distributed random variables with com- 
mon distribution /x. A is the infinite simplex satisfying A = {z = {zi, Z2, ■ ■ ■) z\ > Z2 > • • • > 

o,E£i^.<i}- 
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Lemma [3.21 shows that the (H, 74)-Fleming-Viot process is a jump diffusion type superprocess 
such that between jumping times it evolves like a classical Fleming- Viot process, and at a 
jumping time a fraction of its mass is redistributed over the current support of the process. 

We now consider the martingale problem (MP) related to the SPDE to be considered later 
in Section 5. Let X be the closure of D(A) C Cb{E) with respect to the norm 

11/11 ^ll/lloo + P/lloo, 

where ||/||oo is the supremum norm of /. Denote the dual space of the Banach space X hy X*. 
Introduce the distance in X* by 

OO 

p{X,Y) = J2^-^\X{fj)-Y{f,)\Al), 
j=i 

where {/,} C D{A) is such that span{{fj}) is dense in X. 

A stochastic process X € D{Mi{E)) is a solution to the following generalized Fleming- Viot 
MP (GFVMP in short) if for any / G V{A), 

Ml = {Xt, f) - (/i, /) - f {Xs,Af) ds (3.5) 

Jo 

is a square-integrable martingale such that 

(m^'^)^ = ^2 1^ f) - {X,, ff) ds, (3.6) 

and V G r, the process 

y^lBiAM,)-f[ [ lB(f]zi{5,^-Xs)]^idsdzdx) (3.7) 



martingale such that m{ = Mtif), AMg = - M, 



is a martingale, where M-^'"^ is the continuous part of the martingale M-f and is the A:'*-valued 

/ 

■~^{dsdzdx) = ds ® [ zf "^(^{dz) ® X^{dx) 



is a random measure on R_|_ x A x , and 



T =\^B eB{X*\{d}): yt>0,Ej^j^j^jB (^^Zi{5^^ - Xs)j -f{dsdzdx) < oo"^ . 

Theorem 3.3 The GFVMP has a solution in Dmi[0,oo). Further, every solution X to the 
GFVMP is a (3, A)-Fleming-Viot process. Gonsequently, the GFVMP is well-posed. 

Proof. If X is a solution to the GFVMP, then 

y^{AMs,f)-f f [ f]zi{f{x,)-{Xs,f)hidsdzdx) 
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is a pure jump martingale. Then ()3.ip follows from Ito's formula (Theorem 4.57 of [H]), Lemma 
3.21 and the martingale duality argument. The solution X is thus a (H, 74)-Fleming-Viot process. 

Now we proceed to prove the existence of a solution for this martingale problem. First, we 
suppose that (X^^i zf)~^'EQ{dz) is a finite measure. Without loss of generality, we may assume 
that the total mass is 1. Let < ri < r2 < • • • be the jump times of a standard Poisson process. 
Let Xt be an Afi (i?)-valued process defined as follows. Between the Poisson times, it evolves 
like the usual Fleming- Viot process. At the jump time Tj, we independently choose a A-valued 
random variable (zj) with distribution i^^i zf)~^'^Q, and an E'^-valued random variable {xi) 
with distribution X®^, j = 1, 2, . . . and then set 



<3 



j=l \ i=l / 

It is then easy to verify that Xt is a solution to the martingale problem (jS.Sp . 

In general, we approximate Hq by Vnidz) = ^2^;^^„Ho((iz). Let X" be the solution to 

the GFVMP with Sq replaced by i/„. Then, 

M^ = X^-^i- f A*X^ds 
Jo 

is a sequence of ^Y*-valued martingales. Denote its continuous and purely-discontinuous parts 
by M'^'" and M"'"^, respectively. Then 



and for any B £T, the process 



is a martingale, where A* is the adjoint operator of A. Note that X" is a sequence of -^*-valued 
processes. To prove the tightness of X", we only need to prove the tightness of (X", /) for any 
f £ X. Note that the finite variation part is 

A^= [\x2,Af)ds 
Jo 

and the martingale part MP'(f) has quadratic variation processes 

(Ar(/)), = {a' + Eo{A))l^[{X^,f)-{X^,ff)ds 



Jo JA JEf 



2 



+ / / / {yz^{fix.)-Xnf))\J^{dsdzdx). 



It is easy to prove that {A"} and {(M"(/))} are C-tight. By Corollary 3.33 (p317) and Theorem 
4.13 (p322) of Jacod and Shiryaev [15] (see also Theorem 6.1.1 of Kallianpur and Xiong [16]) we 
see that (X", /) is tight. So, X^ is tight. Similarly, we can prove the tightness of {(M"'^ W''^)}. 
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Denote a limit of {(X", M"'^ M"''^)} by {X,M^,M'^). It is easy to prove that M^{f) is a 
continuous martingale, Mt = Ml + Mf and 



By the same arguments as those in the proofs of Theorem 6.1.3 and Lemma 6.1.11 of |16J, we 
can prove that {M^(/)} is purely-discontinuous, and for any € T, the process 



[•tec / oo oo 



^(dsdzdx) 



0<s 

is a martingale. Thus, (Xt) is a solution to the martingale problem p.Sp . □ 



4 The reversibility 

In this section, we consider the reversibility of the (H, j4)-Fleming-Viot process whose existence 
is justified in the previous section. We will prove that it is irreversible except for the case of 
classical Fleming- Viot process with parent independent mutation. 

To obtain the existence and uniqueness of the invariant measure for the (H, A)-Fleming-Viot 
process we need the following assumption. 

Assumption (I): The Markov process Z with generator A has a unique invariant measure 
V € Mi{E) such that P^n v weakly for any /i S Mi{E) as t ^ oo, where (P^*) denotes the 
adjoint for (Pj). 

Lemma 4.1 Suppose that the Assumption (I) holds. Then, 

(a) The (E, A) -Fleming- Viot process X has at least one invariant measure. 

(h) Let n he any invariant measure of the (B, A)-Fleming-Viot process X. For any positive 

integer n and any f E B[E'^), we have 

I (/i",/)n(d/x) = E(,j)(i.,z,), 

J Mi{E) 

where 

T := inf{t > : |Mt| = 1} 

and {M,Z) is the {3, A)-coalescent starting at {n,f). Consequently, X has a unique invariant 
measure. 

Proof. (a) As PfXQ — )• ly, the family {P^Xq : t > 0} is pre-compact, and hence, tight in 
Mi(E). Thus, for any e > 0, there exists a compact subset of E such that P^ Xq{K^) < e for 
all t > 0. Let 

K, = {p € Mi{E) : p(i^,"fc-i2-.) < k~\ V A: > l} . 
For any J > 0, let /c > 1 be such that < 6. Then, for any p £ K^, we have 

and hence, is tight in Mi{E). Then, is a pre-compact subset of Mi{E). 
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Note that 

rT 



Jo Jo 

Jo 



k=l 

7^ oo 



pi ^ 
■^0 k=l 

< / ^kek~^2"^dt = e. 



Thus, the family ^T~^ PX^^dt : T > o| is tight, and hence, pre-compact in Mi{Mi{E)). 
Let n be a hmit point. Then there exists a sequence (T„) such that T„ t and 



Hm T-^ I PX^^dt = n. 



n—s-oo 







For any s > 0, 



UX-^ = hm T-W PXf^oX^^dt 

n-s-oo Jq 

= hm / PXr^dt 

= n. 



Namely, 11 is an invariant measure of the stochastic process {^i}- 

(b) Note that r < oo. By the moment duality and the strong Markov property we have 



/ (^«,/)n(d/i)= limEn(Xr,/) 

= hm / E^^j)[G^iMt,Zt)]Uidfi) 



lim / K^^j)[G^{Mt,Zt)lr<t]U{dfi) 

JMi(E) 

lim / E( j)E(i^^)[(^,Zf_^)l^<t]n(d/i) 
^^°°Jmi{E) 

lim/ E( j)E(i^^) (/i,Zi)n((i/i) 
hm / K^^j){fi,PtZr)U{dfi) 

JMi(E) 

lim / E(„,^) Z,) n(d^) 



lMi{E) 

= lE(„j) {iy,Zr) , 

where we have used the fact that t < oo a.s.. □ 
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We now consider the reversibility of the (H, 74)-Fleming-Viot process X. 

The transition semigroup (Pt) is irreducible if for any x £ E and / € Cq{E) with / 7^ 0, 
Ptf{x) > for some t > 0, where Cq{E) denotes the space of nonnegative and continuous 
functions vanishing at infinity. 

Lemma 4.2 Suppose that {Pt) is irreducible. If the (B, A)-Fleming-Viot process X is reversible, 
then its mutation generator A is a parent independent pure jump generator, i.e. 



for some 9 > and probability measure vq on E. 

Proof. The result of the current Lemma has been proved for the classical Fleming- Viot process 
by Li et al [18], Handa [12] and Schmuland and Sun j24j with different methods. It is simple 
to see that the barycenter m of a stationary distribution of the classical Fleming- Viot process 
is a stationary distribution for its mutation operator A. A key observation in [18] is that the 
reversibility of A relative to m is structured by the first three moment measures of the classical 
Fleming- Viot process. The necessary form of A was then derived in |18j from Beurling-Deny 
formula of the associated Dirichlet form. 

We shall see that the structures explained above are maintained by the generalized Fleming- 
Viot processes. Our proof is an adaption of the approach for Theorem 1.1 of [18]. The results 
of Lemmas 2.1, 2.4, 2.5 and 2.6 in [18] still hold for the generalized Fleming- Viot process. We 
only need to make some modifications in the first half of the proof of their Lemma 2.1 and the 
second half of the proof of their Lemma 2.5 as follows. By possible time rescaling, without loss 
of generality we assume o"^ + /32;2;0 = 1 in the sequel of this proof. 

For the proof of the analog of Lemma 2.1 of |18j . let 77 be the reversible measure of X and 
define the moment measures 



where we adopt the notation of [18]. Given any partition = to < < ■ ■ ■ < = * and 
f,g,h € T^{A), by the invariance of IJ and the moment duality we have 




m := E/jXt, 1712 := ^nXt ® Xt and 7713 := E/j^t ® Xt Xt 



m2{PtJ ^ Pu+r9) 

= En [Xt,^,.tAPtJ)Xu+^-uiPu+r9)] 




e-{.^+/3..o)(t.+i-t.)]E^ [Xo{Pu^J)X,{Pt^^,+r9)] 



Jo 



{Pti+sfPti+s+r9)) 



= e-{t.+i-t.)^2(Pt.+i/®Pt,+i+r5)+ / dse 




Letting n^oo and tj+i — ti = t/n, we have 



m2{f Pr9) - m2{Ptf «) Pt+r9) 



n-l 



= ImiY, {m2{Puf ® Pu+r9) " m2{Pu+J ^ Pu+,+r9)) 
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We have thus obtained (2.4) of [18]. 

For the proof of the analog of Lemma 2.5 of [IB] by the reversibihty and the moment duahty 
agam, 

En[X^\f ® g)XoiPth - h)] 
= J Uidfi)E^[iXf^if0g)-X^\f®g))Xoih)] 

= J U{dfi)K^ [Xo{h) (^e-^-^'+^^-^^-^^^'xf{Ptf ® Ptg) ^^'^^ 
+ 1^ ds{a^ + /32;2;o)e-('^'+''^^^^°)^Xo(Pt_.(P./P.5))^is - X^\f ® 5)) • 

Dividing both sides of (j4.ip by t and letting t 0+, we have 

^n[X^\f®g(^Ah)] 

= ¥.n[Xf{Af ^g(^h + f®Ag®h-{a^ + /32;2;o)/ ®g^h) + Xf{{a^ + h,2-fl){f9) ® h)] 
= ¥.n[X®^{Af (S)g®h + f®Ag®h-f®g®h)+ X^\{fg) ® h)]. 

So, 

"^3(/ Ah) = 7ns{Af ®g®h + f^Ag(^h-f®g®h)- m2{{fg) ® h). 



The rest of the proof then follows from that in Lemma 2.5 of |18j . 

The same argument for Theorem 1.1 of [18| can also go through for the generalized Fleming- 
Viot process. □ 

Lemma 4.3 If jip-p-o = for some p > 3, then the 'E-coalescent degenerates to Kingman's 
coalescent. 

Proof. For any p > 3, by (j2.ip we have 



If /3p;p;0 = 0, then Hq must be a zero measure since has no atom at zero, and the integrand is 
always positive except at zero. Therefore, the H-coalescent degenerates to Kingman's coalescent. 

□ 

Theorem 4.4 Suppose that (Pt) is irreducible and space E contains at least three different 
points or E = {61,62} with 1^0 ({ei}) 7^ ^o{{^2})- Then the (E, A) -Fleming- Viot process X is 
reversible if and only if it is the classical Fleming- Viot process with parent independent mutation. 

Proof. If the generalized Fleming- Viot process X is reversible, then there exists an invariant 
measure, say H, satisfying 

/ Gpj(^)LG,,,(^^)n(d^^) = / G,,3(^)LGpj(M)n(dM), (4.2) 

JMi{E) JMi[E) 
where p and q are arbitrary nonnegative integers. 
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By Lemma [4.2l the generator ^4 is a parent independent jump operator. Also note that vq has 
a support E since {Pt) is irreducible. If E contains at least three different points or E = {ei, 62} 
with 1^0 ({ei}) 7^ 1^0 ({62}), we can choose F C E such that 

z.o(F) = a/0, 1/2,1. 

Taking p = 1, q = and / = 1^ in ()4.2p we get 

n{F)U{dfi) = a. (4.3) 



lMi{E) 

Taking p = 2, q = and / = IfxF, we get 



/ 



^ {F)U{dn) = 

(E) +P2;2;0 + 



AFW,) = ,T":T «- (4.4) 



Taking p = 3, q = and / = IfxFxF, we get 

^ ^ ^ 3ct2 + 3/33;2;l + /33;3;0 + 1^ 

Taking p = I, q = 2, f = If and 5 = IfxF, we get 

/ ^^\F)U{d^l) X f /32;2;0 + + ^ V / M'(i^)n((i^) X f /32;2;0 + + ^) = 0. (4.6) 

Plugging in Equations (|4.4p and (j4.5|) . Since /33;2;i = /32;2;0 — /33;3;0 (consistency condition), then 
Equation ()4.6p is equivalent to 

/33;3;o02^(2a-l)(a-l) _ ^ ^^^^^ 



+ /32;2;0 + e)(6a2 + 6/32;2;0 " 4/33;3;0 + 3^) 

Note that 

6<t2 + 6/32;2;0 - 4/33;3;0 + 30 = Ga^ + 6/33;2;i + 2/33;3;0 + 30 > 0, 

6 > and q ^ 0,1/2,1. Consequently, we have (^s-s-o = 0. By Lemma [4.31 we have Hq = 0. 
Hence, Xf becomes the usual Fleming- Viot process with parent independent mutation, which is 
known to be reversible. □ 

In the following we consider the reversibility for several classes of (H, A)-Fleming-Viot pro- 
cesses under the condition E = {61,62} with i/o({ci}) = 1/2 = i^o{{^2})- The proofs will be 
given in the Appendix. 

For /3 G (0, 2), the (Beta(2— /3, /3), A)-Fleming-Viot process is the (H, 74)-Fleming-Viot process 
with measure E supported on [0, 1] satisfying 

Proposition 4.5 Given any parent independent pure jump generator A on E = {61,62} with 
^o({ei}) = i^o({e2}) = a = 1/2, the {Beta{2 — f3, f3), A)-Fleming-Viot process is not reversible. 
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Proposition 4.6 Given any parent independent pure jump generator A on E = {61,62} with 
^o({ei}) = i^o({e2}) = OL = 1/2, the (B, A)-Fleming-Viot process with the finite measure H on 
[0, 1] defined as 

'E{dx) = x~^dx 

for some 7 € (0, 1) is not reversible. 

Proposition 4.7 Given any parent independent pure jump generator A on E = {61,62} with 
^o({ei}) = t'o({e2}) = a = 1/2, the (B, A) -Fleming- Viot process with H = 5i, the point mass on 
[0, 1], is not reversible. 

Sagitov [22] introduced the Poisson-Dirichlet coalescent with parameter e as fonows. Let H 
be the Poisson-Dirichlet distribution Il^{dx) with a positive parameter e on the infinite simplex 



00 

Xi 

i=l 



Then the He-coalescence rates are 

Xb-M,-,kr;s="-^Yl^h-lV. (4.9) 

i=l 

for all r > 1, /ci, . . . , /c^ > 2 and s > 0, where 5 = /ci + • • • + A;^ + s and 

= e(e + 1) . . . (e + 6 - 1) 

is the ascending factorial power. 

Proposition 4.8 Given a parent independent pure jump generator A on E = {61,62} with 
z^o({6i}) = i^o{{e2}) = a = 1/2, the (E, A)-Fleming-Viot process with 3 = 11^ is not reversible. 

Remark 4.9 For E = {61,62} with i/o({ei}) = 1/2 = i^oi{^2}), we conjecture that the H- 
Fleming- Viot process is reversible only if it degenerates to the classical Fleming- Viot process. 



5 An SPDE for the (S, iA)-Fleming-Viot process 

In this section we switch to a different topic and consider the weak and strong uniqueness for 
solution to an SPDE associated to the (H, | A) -Fleming- Viot process, where A = denotes 
the Laplacian mutation generator. Note that A is also used to represent the set of infinite 
dimensional simplex in this paper. Throughout this section we assume the type space E to be 
the real line M. 

Next, we hope to characterize the (H, ^A)-Fleming-Viot process by an SPDE which has 
strong uniqueness. Here we adapt the approach of Xiong [25]. For a measure X, we define the 
distribution function 

u{x) = X{{-oo,x]), VxGE. (5.1) 
Let u~}{y) = mf{x : Us-{x) > y}. Consider the following SPDE 

ut{x) = uoix) + a [ I {ly<us-{x) - Us-ix)) B{dsdy) + [ ^Aus^{x)ds 
Jo Jo Jo ^ 
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ft r r I \ 

/ / / 5^ (x) - yi^j^is- (a;) M^lc^sfizc??/), (5.2) 

Jo J A Jio,ir - t^, J 



where B{dsdy) is a white noise on x (0, 1] with intensity dsdy and M{dsdzdy) is an indepen- 
dent Poisson random measure on x A x [0, if with intensity ds {YZ^i zf) ^o{dz){dy)®^ . 

Denote (/, g) := f{x)g{x)dx for functions / and g on M. We say an M-valued random field 
u = : t > 0, X € M} is a solution to the SPDE (fOj) if for any / G C^(M), the collection 

of compactly supported functions on M with continuous second derivatives, 

(utj) ={uo,f) + a I I I {ly<us-(x) -Us-{x)) f{x)dxB{dsdy) + I (us-,l:f")ds 
Jo Jo Jr Jo \ / 

„f„„„/oo oo \ 

+ / / / / y]^ily,<Ms-(x) - y'^i'Us-lx) /(2;)(ixM(dsdz(iy). 
Jo J A Jio,if Jr ~ 7^1 J 

A weak solution to the SPDE (|5.'2p is a probability space (0, J^, P) together with a filtration 
(J-f) and adapted processes {u,B,M) such that ()5.2p holds. 

Theorem 5.1 The SPDE i5.2\) has a weak solution. If the random field ut{x) is a solution to 
the SPDE i5.S\) . then the measure-valued process X defined by i5.1\) is a (H, ^A)-Fleming-Viot 
process. Consequently, the SPDE US. ^|) has a unique weak solution. 



Proof. Suppose that the SPDE (|5.2p has a solution. For any / € Cq(M), we have 

{XtJ) = -{utJ') 

= -{uoJ')-crl I I {ly<u,_ix) - Us-{x)) f'{x)dxB{dsdy) - I lus^,]rf"')ds 
Jo Jo Jr Jo \ ^ / 

Jo J A J[o,i]N Jr ~ 7^1 J 

= {Xo,f)-al^ 1^ ^df{x)-{us.,f')^ B{dsdy) + 1^ (^Xs-,^f"^ds 

ft f f / oo oo \ 

- E ^/(^) - E M{dsdzdy) 

Jo JAJ[o,ir ■^''s-iy^) 7^1 J 

= {Xo,f) + aJ^J^ {f{u;l{y))-{X,.,f))B{dsdy) + (^Xs-,^f"^ds 

„ „ / oo oo \ 

+ / / / E ^ifi^s-iVi)) - E M{dsdzdy). 
Jo J A J[o,ir \7^i ~t J 



Thus, 



Mt{f) = {XtJ)-{Xo,f) 



is a square-integrable martingale with continuous part 



= a f C {f{u-l{y)) - B{dsdy) 



JO 
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and pure jump part 
Mfif) = 

Then 



/ / / [y2zifiu;l{y^))-y2zi{Xs-,f)]M{dsdzdy). 

Jo J A j[o,if vtr J 



(M^(/)), = a' f [\f{n;l{y))-{Xs^J)fdyds 



^0 



2 

a 



^0 



f{uiHy)?-'2{XsJ)fKHy)) + {XsJf) dyds 

1^ (^{Xs, f) - {Xsjf) ds. 



Further, 



1b(AM,) - 1^ 1^ 1^^^^^ Is (± [k,Hv.) - ^^")) (E ^o{dz)dyds 



0<s<t 

is a martingale. As 



1b E (^"-'(y.) ~ ^^-) E ^o{dz)dyds 



we see that 

V Isi^AQ - [ [ [ 1b ( V {6,, - X,) ] ^{dsdzdx) 

is a martingale. Therefore, is the generalized Fleming- Viot process. 

The existence of weak solution follows from Theorem 13.31 □ 



Next, we consider the backward version with T fixed: 

vt{x) = UT-t(.x), vte[o,r], xgm. 

Note that vt is left-continuous with right limit. We also define the backward random measure 

B{[0,s] xA) = B{[T-s,T] x A), V s G [0,r], A G S([0,1]). 

The random measure M is defined similarly. Then, {vt{x)} satisfies the following backward 
SPDE: 



vt{x) = uo{x)+a / {ly<^^^(^^) - Vs+{x)) B{dsdy) + I -Avs+{x)ds 



It JO 
cT r r /CO 



It 2 

+ / / / y'^ilyi<i;,+ (x) -y'2i^'s+(a;) M(ds(i2(iy), (5.3) 

Jt JAJ[o,ir\frt - / 
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where ds denotes the backward Ito's integral. 

It is clear that if (|5.3p has a unique solution, so does ()5.2p . and vice versa. To prove the 
uniqueness of the solution to (|5.3|) , we adapt the idea of Xiong [25] by relating it to a backward 
triply stochastic differential equation (BTSDE). Denote 

VF*'^ = x + Ws-Wt, yt<s<T, 

where Wt is a one-dimensional standard Brownian motion. 

Fix t and x, we consider the following BTSDE: For t < s < T, 

+ 111 (Y.^i\.<YX--12^i^r+]Midrdzdy)- f Zl^'^dWr. (5.4) 



Let Qt = (T{Ql,Qt) where Ql (non-decreasing) and (non-increasing) are independent sigma 
field families such that for any C G} and J'J^j^^ C , where 

tB.m_^( i?([r,r]x^i), M([r,r]x^2xA3), \ 

^ V ^ G [i,T], Ar G ^([0,1]), A2 e B{A) and A-, G ^([0,1]^) J ' ^^'^^ 

The solution {Ys''' , Z^'^') to the BTSDE §^ is ^.-adapted. 

To establish the connection between the backward SPDE ()5.3|) and the BTSDE ()5.4p . we 
need the following extended Ito's formula. 

Lemma 5.2 Let Yt be a process given by 

Yt = YT+ [ [ Gi{r,u)B{drdu)+ [ [ G2{r,v)M{drdv) - f ZrdWr, 

Jt JUi Jt JU2 Jt 

where B is a Gaussian white noise with intensity fii{du)ds and M is a Poisson random measure 
with intensity ^2{dv)ds. Further, Gi : [0,T] x Ui x Q ^ M, i = 1,2, are Gt adapted, where Gt is 
defined by i5.5]) with obvious modification. Then, for any f G C^(M), we have 

f{Yt) = f(YT)+ r [ f'iYs)Giis,u)B{drdu) - r fiYs)ZsdWs 
Jt JUi Jt 

^ [ {f{Ys+ + G2is,v))-fiYs+))M{drdv) 
t JUi 

[ (/(y, + G2{s, v)) - f{Ys) - f'{Y,)G2{s, v)) f,2idv)ds 

t JU2 

nY,)Giis,uft^iidu)ds-^J^ Zlf"{Ys)ds. (5.6) 

The proof of (j5.6p follows from that of the standard Ito's formula for semimartingale driven 
by Brownian motion and Poisson random measure; see Chapter II of [T^. Here, we omit the 
detail. 

Since the second order moments of Xt are the same as those for the classical Fleming- Viot 
process, by the same arguments as in the proof of Lemma 2.3 of Konno and Shiga [IT] we can 
show that almost surely, Xt has a density for almost all t. 

Let be the Brownian semigroup with the corresponding heat kernel. 
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Lemma 5.3 Suppose that Xq has a density dxUo € L^(]R, e l^'dx). Then, there exists h G 
L^{[0,T] X ]R,e"2|^ldx(it) such that 



lim E / / (TsXt(x) - htix)fe-^\''\dxdt = 0. 
5^0+ Jo Jr 



_____ E 

5^0+ 

Proof. For any 5, 5' > 0, by the moment duality we have for A = Eq{A), 

E / dt [ {TsXt{x) -Ts>Xt{x)fe-'^\''Ux 
Jo Jr 

dt [e( [ ps{x - y)Xt{dy) - I ps>{x-y)Xt{dy)] e'^l-lfix 
Jr \Jr Jr / 

dt / e'^l'^'lfia; / Xe'^^ds / Xo{dy) / ptsiv - z) {ps+s{x - z) -ps+5'{x - z))^ dz 
'0 Jr Jo Jr Jr 

+ f e-^'dt [ e-2|^ldx ( / Xoidy)pt+5ix - y) - [ Xo{dy)pt+s' {x - y) 
Jo Jr 

For Xo{dy) = Xo{y)dy, 

"^'""Ifix { / {pt+six - y) - pt+s'{x - y))XQ{y)dy 
\Jr j 

< I e-2|-ldx / ipt+six-y)-pt+s'ix-y)fe\y\dy I X^{yf e-\y\ dy . 
Jr Jr Jr 

We can show that 

\pt+5{z) -pt+6'{z)\ < t-'\6' - 6\C{T){1 + z^){pt+5{z) +Pt+S'{z)). (5.7) 
Then for < q < 1/4, 

/ e-2Ndx [ {p,^s{x-y)-pt+s'{x-y)T^^-''e\yUy 
Jr Jr 

< 1^ _ 5rt-^^C{T,a) [ e-^\^\dx / (1 + (x - yfT {Pt+s{x - y?+Pt+S'{x - yf) e^^^dy 

Jr Jr 

< |5' -5rt-2"-V2c7(T,a). 
Consequently, 

T / \ 2 

hm / e~^'dt [ e-^^'^Uxi [ Xo{dy)pt+six-y)- [ Xo{dy)pt+s'ix-y)] =0. 



S,S'^0+JQ 

By Equation (|5.7p . for < a < 1/4, we have 

Xo{dy) / Pt-siy - z) {ps+5{x - z) - Ps+5'{x - z)f dz 



< (27r(t - s)) / XQ{dy) / {ps+s{x - z) - Ps+s'{x - z))"''^'^ " dz 
Jr Jr 



< |5 - (5' rC (T, a) (t - s)-i/25-2""i/2_ 
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Therefore, 

lim [ dt [ e-2|^ldx / Xe~^'ds [ Xo{dy) [ pt^s{y-z) {ps+six - z) - Ps+s'{x - z)f dz = 0. 

Then ^ 

hm E /" [ {TsXt{x) - Ts'Xt{x)fe-^\''^dxdt = 

5,S'^0+ Jq 7k 

and the desired result follows. □ 

Although for a.e. s, the function hs{x) is defined for a.e. x S M, the quantity hs(Ws'^) is a 
well-defined random variable when s > t since the law of Wg'^ is absolutely continuous. 

Theorem 5.4 Suppose that OxUq € L'^{M.,e~^^^dx). If {vt{x)} is a solution to i5.!^) such that 
Vt{x) is differentiable in x and 

E / [ {dxVt{x)fe-^\''\dxdt < oo, 
Jo Jr 

then vt{x) = Y^'^ a.s., where {Yg'^} is a solution to the BTSDE \5.^\) . 

Sketch of the proof Since the main idea is the same as that of Theorem 4.1 in |25j . we only 
give a sketch. Applying T5 to both sides of ()5.3p . we get for ff := T^Vs 

vf{x) = ul{x)+ r f f Gi{y,Vs+{l))ps{x-l)dlB{dsdy) 

Jt J[0,1] 

+ / // [ G2iy,z,Vs+{l))p5{x-l)dlM{dsdzdy)+ [ ^A^;f+(x)(is, 

Jt JAJ[0,lfJR Jt ^ 

where G\ and G2 are the obvious integrands of ()5.3p . 

Let s = to < ii < • • • < in = be a partition of \s,T\. Writing T^^Vs^l'"^) - T^vtC^^'^) 
into telescopic sum, we have 

n—l n—1 

= E(4(^^)-4«J)+E 

1=0 i=0 

n—l „t , , -, n—l I , 

-^vl{Wl^^)dr -Y, 

i=0''*» j=0 



' i=0 

n—l />i 1 n—l />i 

i=0 j=0 

+ E / / -OGi(z,i;,+ (/))fiZS(drdz) 

ft +1 1 



j=o " 



Letting the mesh size decrease to zero and taking 5 — )• 0, we see that 

y^*'^ = VsiWl'"") and Z*'^' = d^VsiWl^''), a.e. E {t,T] x 1^, 



is a solution to the BTSDE (|5.4|) . By the continuity of in s and the continuity of Vs{Wj_'^^ 



s 



at s = t, taking s \,t,we get the conclusion of the theorem. □ 
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Applying Yamada-Watanabe's argument, we can get the following result. 
Theorem 5.5 The BTSDE |5.-^[j has at most one solution. 



Proof. We drop the superscript (t, x) in ()5.4p for simplicity. Suppose that ()5.4p has two 
solutions {Y^,Zl), ^ = 1, 2. Let (cfc) be a sequence of decreasing positive numbers defined 
recursively by 

ao = 1 and / z^^dz = k, k > 1. 

Ja-k 

Let il^k be non-negative continuous functions supported in (afc,afc_i) satisfying 

'4jk{z)dz = 1 aivdi^kiz) <2{kz)~^, V z e M. 



Let 

(f)k{z) = dy il)k{x)dx, V z e M. 

JO JO 

Then, (/>fc(z) \z\ and < 2k~^ . 

Denote Ui = [0, 1] and [/2 = A x [0, 1]^. Let Gi and G2 be the integrands for the backward 
stochastic integrals in ()5.4p . Note that 

l-T 

dW. 



Yt'-y? = r [ {G,{uX) - Gi{u,Y^)) B{dsdu) - r {Zl - Zl 
Jt JUi Jt 



+ [ [ {G2iu, Y}) - G2{u, y,2)) M{dsdu). 
Jt JU2 



By Ito's formula, we get 
MYl-Y?) 

f-T 



[ [ MYs'-Y,^){Gi{u,Y})-Gi{u,Y,^))B{dsdu) 
Jt JUi 

- <p'j,{Y} - Y^) [Z] - Zl) dWs 

+ r [ {MYs\ - Y,l + G2iu, y,V) - G2(n, Y,^^)) - MYs\ - Y,\)) M{dsdu) 
Jt JU2 

\[ ^'L{Y}-Y^) {Giiu,Y}) - G,iu,Y,^))' fii{du)ds 

r [ (mYs'-y,^ + G2{uX)-G2{uX)) 

Jt JU2 V 

-MYs' - Y,^) - <P'k{Y}_, - y!^){G2{u,Y}) - G2{u,Y^))jiJi2{du)ds 
\ c^UY} - Y^) [Z] - Zlf ds. (5.8) 



+ 



+ 



Note that 

\Gi{u,yi) - Gi(u,y2)f\ii{du) < K\yi - y2\. 

Ui 
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Taking expectation on both sides of (|5.8p . we get 



EMYt' - Y^) <KeI^ cl^liY} - Y^)\Y} - Y^\ds < KTk-\ 



Taking k ^ oo and making use of Fatou's lemma, we have 



Therefore, Y^^ = Y^ a.s. The uniqueness for Z fohows easily. □ 



As a consequence of the last two theorems, we see that the SPDE ()5.2p has a unique strong 
solution. 

6 Appendix 

We consider the case of E = {ei, 62} with z^o(ei) = 2^0(62) = 1/2 in this Appendix. Let F = {ei}. 
For convenience, we denote 02 = /32;2;0 + o-i = ^ = 3,4,5,6, 021 = /33;2;i + i^^, 

0-211 = /34;2;2 + f^, 022 = /34;2,2;0) OSl = P4;3;l, 02111 = /35;2;3 + ^221 = /35;2,2;l! ^311 = /35;3;2, 
0-32 = /35;3,2;0) ^41 = /35;4;1, ^21111 = /36;2;4 + 17^, 02211 = /36;2,2;2, ^3111 = P6;3;3, 0222 = /36;2,2,2;0) 
O32I = /36;3,2;1, ^411 = /36;4;2) ^33 = /36;3,3;0; ^42 = P6;4,2;0, O5I = Pg;^;!- Let 



mi = / fi\{ei})U{dfi), 

JMi{E) 

where i = 1, 2, . . . , 6 and 11 is the invariant measure. By the consistency condition, we have 



021 = 


02 


022 = 


02 


031 = 


03 


041 = 


O4 


O22I = 


1 

" 5 


0311 = 


3 
5 


032 = 




O22II 





03, 

203 + 04 - 0211, 
04, 
05, 

4 I I 1 2 2 

— 5O3 + O4 + 5O2II — 5O2III — gOS, 

11 — |o2 + §03 — 2O4 — ^02111 + §05, 

§03 + io2lll + |o5 - |o211 + |02, (6.1) 
14 2 4 2 3 8 1 1 

Y5O3 + 04 + ^02 — 5O5 — 3O33 — 042 — 50211 + Y5O2111 — 3021111 + 3O6, 

0222 = 2 0211 — 02 + I 03 + I 033 + 3 042 — 1 02111 + \ 021111 — 5 oe, 

03111 = — f 02111 + ^ 03 — 3o4 — I 02 + ^ 05 + 2 033 + 8042 + I 0211 — 06, 

231 31 
0321 = 5 02 — 5 03 + 5 05 — 033 — 042 — 5 0211 + 5 02111, 

0411 = 04 — 2 05 — 042 + og, 

051 =05 — 06. 

Taking p = 1, g = and / = 1^? in Equation ()4.2p . we get 

mi = a = 1/2. (6.2) 
Taking p = 2, (7 = and / = IfxF in Equation ()4.2p . we get 

02 + 9a 2o2 + 9 
m2 = Tr^i = 7^. (6.3) 

02 + 6* 4(02 + 6*) ^ ' 
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Taking p = 3, q = and / = IpxFxF in Equation (j4.2p . we get 

_ asmi + (3 021 + I 6) «) m2 _ 4a2 + g 

- 3a2i+a3 + i0 " 8(a2 + e)' ' 

where we have apphed the consistency condition 021 = 0,2 — and canceled the common positive 
factor 

3 3 
3a2 - 2a3 + 2^ = ^021 + 03+2^ 

from both the denominator and the numerator. 

Taking p = 4, q = and / = IfxFxFxF in Equation (|4.2|) . we get 

041111 + (4 031 + 3 022) m2 + (6 0211 + 2 6' a) m3 
1114 = 



6 0211 + 3 022 + 4 031 + 04 + 2 ^ 
6*2 - 4036! + 10026* + 2046I + I2021102 + 12o^ - 80302 
" 8 (3o2ii + 3o2 - 203 + 26) (02 + e) 

e"^ - Aa^e + 10026* + 2046I + I2021102 + 12o^ - 80302 



(6.5) 



8 (6 0211 + 3 022 + 4 031 + 04 + 2 61) (02 + 61) 
where 30211+302 — 203+26* = 6o2ii+3o22+4o3i+O4+20 fohows from the consistency condition. 

Taking p = 1, q = 3, f = Ip and g = IpxFxF in Equation (|4.2|) . we get 

(3o2i + 6* a) m3 + 031112 - (3o2i + 03 + 6*) m4 = 0. (6.6) 

Plugging in Equations (|6.3p - (|6.5p . Equation (|6.6p becomes 

OB _ OB 

(3o2ii + 3o2 - 203 + 261) (02 + 9) ~ (60211 +3o22 + 4o3i + 04 + 26I) (02 + 6*) 

= 0, 

where 

B := (—603 + 3o2 — 3o2ii + 404) + I204O2 — 2203O2 + 603O211 — 60211O2 — 804O3 + 12o| + 6o|. 
By the consistency condition, we have 

— 603 + 3o2 — 3o2ii + 4o4 = 04 + 3022- 



If 04 + 3o22 = 0, then the H-coalescent degenerates to Kingman's coalescent by Lemma 14. 3| 
otherwise, 04 + 3o22 > and we have 

^ 2 (604O2 - 11 03O2 + 303O211 — 30211O2 — 404O3 + 603^ + 3 02^) „^ 

9=— (6-7) 

—04 — 3022 

which further imposes a necessary condition for the (H, A)-Fleming-Viot process in case oi E = 
{61,62} with i^o({6i}) = t'o({62}) = 1/2. 
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With Equation ()6.7p we can compute higher moments to reach a contradiction. Taking p = 5, 
q = and / = IpxFxFxFxF in Equation (|4.2p . we get 



(6.8) 



asHii + (10 + 5 041) m2 + (15 0221 + 10 0311) 1113 + (lO 02111 + ^ a) 

= ^ 5 

10 02111 + 15 0221 + 10 0311 + 10 032 + 5 041 + 05 + I 6* 

_ {0 - 60211 + IO04 + 2O02 - I603) 9 - I60302 + 24o| + 24021102 

~ 16 (02 + e) (3o2ii + 3o2 - 203 + 29) 

_ {0 - 60211 + IO04 + 2O02 - I603) 9 - I60302 + 24o^ + 24o2ii02 

~ 16 (02 + 9) (6 0211 + 3 022 + 4 031 + 04 + 2 9) ' 

where we have apphed the consistency condition and canceled a common positive factor 

5 5 
4o2iii + 3o2 - 203 + 3o2ii + 2^ ^ IO02111 + 150221 + IO0311 + IO032 + 5o4i + 05 + -0 

from both the denominator and numerator. 

Taking p = 6, q = and / = IpxFxFxFxFxF in Equation ()4.2p . we get 

ogmi + (6 051 + 15 042 + 10 033) m2 + (15 0411 + 60 0321 + 15 0222) "13 
me = 

^ (6.9) 

(2O03111 + 45q22ii) m4 + (15 021111 +39a)m5 
+ ^ 

where 

C := 06 + 6 051 + 15 042 + 10 033 + 15 0411 + 60 0321 + 15 0222 + 20 03111 + 45 02211 + 15 021111 +3 6*. 
Taking p = 1, q = 5, f = Ip and g = IfxFxFxFxF in Equation (|4.2p . we get 
05102 + (10 032 + 5041) m3 + (IO0311 + 15o22i) m4 + (IO02111 + 26*0) ms 

(6.10) 

- (05 + 10 032 + 5 041 + 10 0311 + 15 0221 + 10 02111 + 2 6*) mg = 0. 

Plugging in Equations ([631), dElD, dSS]), dHS]), and ([STD, Equation (fHlH only involves the 
collision rates. We can then consider examples of coalescents in which those rates are specified. 
Proof of Proposition 14.51 Let M„ = x^E (dx). It follows that 

r (n + 2 - /?) 



" (n + l)!r(2-/3)- 
By integral representation of the coalescence rates, we have 

02 = Mo, 03 = Ml, 04 = M2, 0211 = Mo - 2Mi + M2, 

05 = M3, 02111 = Mq - 3Mi + 3M2 - M3, 042 = 0, 

033 = 0, 06 = M4, 021111 = Mo - 4Mi + 6M2 - 4M3 + M4. 

The value of 9 can be obtained by Equation (|6.7p . Plugging in the values of coalescence rates 
and 9 to Equation ()6.10p . we have 

(/3-2) (^-3) (/3 + 1) (/34 + 8/33 -39/32 + 6/3 + 72) 



(/32 + 3) (/34 + 6/33 - /32 - 126/3 - 72) 



0. 



We can not find any /3 € (0, 2) to satisfy the above equation, which contradicts the reversibility. 
Therefore, the (Beta(2 — /3, /3), A)-Fleming-Viot process is not reversible. □ 
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Proof of Proposition 14.61 Let M„ = x'^E (dx). We have 

M„ = l/{n+l-j). 

The values of 02, as, 04, a2u, 0.5, 02111, o-q, 021111 and 6 can be similarly expressed in terms of 7. 
Note that 042 = 033 = 0. With the consistency condition ()6.ip and the moments obtained from 
Equations (|6.2p - (j6.5p . (j6.8p - ()6.9p . we plug in those values to Equation (|6.10p . It follows that 

-^ + ^ 0. 



(-4 + 7) (-6 + 7) (73 - 1472 + 61 7 - 120) 

There is no 7 € (0, 1) satisfying the above equation. Therefore, such a (H, A)-Fleming-Viot 
process is not reversible. □ 

Proof of Proposition 14.71 If H = 5i, the corresponding coalescent only allows all the blocks 
to merge into a single block. Then we have 02 = 1, 03 = 1, 021 = 0, 04 = 1, 031 = 0, 022 = 
and 0211 = 0. By Equations (j6.3p - (|6.5p . the moments m2, and can be expressed by 9. 
Plugging in these values to Equation ()6.6p . we have 



{I + 9) (1 + 26) 



Since 6 is positive, we get a contradiction. Therefore, the corresponding (H, ^)-Fleming-Viot 
process is not reversible. □ 

Proof of Proposition 14.81 Bv Equation ()4.9p . the coalescence rates 02, as, a2i, 03I1 022, 
^211) ^5) ^41, 032, 0311, 0221, 02111, oe, osii ^42, 033, 0411, 0321, 0222, 03111, 02211 and 021111 are 
all available. Then the moments mi, m2, ms, m4, and mg can be expressed by e and 9. 
The value of 9 can be obtained by Equation ()6.7p . Replacing all of these values in Equation 
(lUnUj) . it follows that 

(lOe^ + lie + 6) e2 



(5e + 6) (6 + lie) (ITe^ + lOQe^ + SlQe^ + 394e + 120) (1 + e) 

We can not find any positive e to satisfy the above equation. Therefore, the corresponding 
(H, ^)-Fleming-Viot process is not reversible. □ 
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